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Abstract 

Subgame perfect equilibria are specific Nash equilibria in perfect information games in ex¬ 
tensive form. They are important because they relate to the rationality of the players. They 
always exist in infinite games with continuous real-valued payoffs, but may fail to exist even 
in simple games with slightly discontinuous payoffs. This article considers only games whose 
outcome functions are measurable in the Hausdorff difference hierarchy of the open sets {i.e. 

A 2 when in the Baire space), and it characterizes the families of linear preferences such that 
every game using these preferences has a subgame perfect equilibrium: the preferences with¬ 
out infinite ascending chains (of course), and such that for all players a and h and outcomes 
x,y,z we have -^{z <a y <a x A x <b z <b y). Moreover at each node of the game, the 
equilibrium constructed for the proof is Pareto-optimal among all the outcomes occurring in 
the subgame. Additional results for non-linear preferences are presented. 

Keywords: infinite multi-player games in extensive form, subgame perfection, Borel hierarchy, 
preference characterization, Pareto-optimality. 


1 Introduction 

Game theory is the theory of competitive interactions between agents having different interests. 
Until the late 1960’s an agent would usually represent a human or group of humans, when 
game theory was mainly meant for economics and political science. Then game theory was also 
applied to evolutionary biology [21] and to theoretical computer science |1| , especially to system 
verification and system synthesis (against given specifications). Classically, the verification or 
synthesis problem is represented as a game with two players: the system trying to win the game 
by meeting the specifications, and the environment trying to win the game by preventing the 
system from doing so. The two players play this game in turn and deterministically on a finite 
or infinite directed graph, and the key notion is that of winning strategy. For a decade, though, 
computer scientists such as Ummels [26] have been considering multi-player games to represent 
more complex verification or synthesis problems, e.g. relating to distributed systems. The notion 
of winning strategy is specific to two-player win-lose games, but in a multi-player setting it may 
be replaced with a faithful extension, namely the famous notion of (pure) Nash equilibrium. 
It does not only accommodate more than two players, it also allows for refined/quantitative 
objectives. 

The deterministic turn-based games on graphs may be unfolded, usually without much loss 
of information, into deterministic turn-based games on finite or infinite trees, which have been 


1 


widely studied in game theory. It is one reason why this article focuses on perfect information 
games in extensive form (ie. played on trees) and their deterministic strategies, unless otherwise 
stated. 

Kuhn [12] proved the existence of Nash equilibrium (NE) in finite games with real-valued 
payoffs. His proofs uses backward induction and constructs a special kind of NE that was later 
called subgame perfect equilibrium (SPE) by Selten [23]. An extension of Kuhn’s result [13] 
characterizes the preferences that always yield hnite games with NE/SPE: the acyclic prefer¬ 
ences. Also, Escardo and Oliva [S] studied generalizations of backward induction in possibly 
inhnite yet well-founded game trees, i.e. without infinite plays. The SPE have nice extra prop¬ 
erties and are usually preferred over the more general NE: for psychology in a broad sense an 
SPE amounts to the absence of empty threats, and for system engineering in a broad sense it 
amounts to stability of a system regardless of the initial state. 

The concept of inhnite horizon is convenient in economics and also in computer science, 
e.g., for liveness. Gale and Stewart [9] studied inhnite two-player win-lose games, but backward 
induction is no longer applicable since there may not be leaves to start the induction at. Nev¬ 
ertheless, they proved that if the winning set of each player is open or closed (with the usual 
topology), one player has a wining strategy. This result was extended by Wolfe [27] for ^2 and 
n 2 sets, then by other people to more complex sets, and eventually by Martin for Borel m and 
even quasi-Borel [20] sets. This is called (quasi-)Borel determinacy. 

Mertens and Neymann m p. 1567] found that Borel determinacy can be used to show 
existence of e-NE in inhnite games with bounded Borel-measurable real-valued payoffs. By 
generalizing their technique, an abstract result about point-classes and determinacy [2] implies 
a characterization of the preferences that always yield games with NE, in games with (quasi- 
)Borel-measurable outcome functions, countably many outcomes, and an arbitrary cardinality 
of players: the preferences whose inverses are well-founded. Then it was shown m that two- 
player antagonistic games (i.e. abstract zero-sum games) with hnitely many outcomes and 
(quasi-)Borel-measurable outcome function have SPE. 

When the outcome function is a continuous real-valued payoff function, Fudenberg and 
Levine [8] showed that there is always an SPE in multi-player games. Similar results were 
obtained recently via an abstract and uniform density argument m- The continuity assumption 
may be slightly relaxed if one is willing to accept approximate SPE. Indeed existence of e-SPE 
was proved for lower-semicontinuous [U] and upper-semicontinuous [22] payoffs. 

However, when the real-valued payoff function is discontinuous enough and the preferences 
are not antagonistic, there may be no (e-)SPE, as in the following example which is similar 
to [251 Example 3]. Let a and b be two players with preferences z <a y <a x and x <b z <b y- 
They are alternatively given the possibility to stop and yield outcomes y and z, respectively, 
but the outcome is x if no one ever stops. 

start-> a —> b —*■ a —> b-x 
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y z y z 

In addition, a real-valued two-player game [7] was recently designed with the following features: 
it has a similar preference pattern as in the example above, and it has no e-SPE for small enough 
e even when the players are allowed to use mixed strategies at every node of the game tree. All 
this shows that Mertens [21] was right when writing that ’’Subgame perfectness is a completely 
different issue” from NE. This article solves the issue partially, and the contribution is two¬ 
fold. First, it characterizes the linear preferences that always yield SPE in games with outcome 
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functions in the Hausdorff difference hierarchy of the open sets: the preferences that are void 
of infinite ascending chains (of course) and of the SPE killer from the example above. Said 
otherwise, if ->{z <a y <a x A x <h z <h y) holds for all players a and b and all outcomes x, y 
and z of a multi-player game with outcome function in the difference hierarchy (and preferences 
without infinite ascending chains), the game has an SPE, and even a global-Pareto one, as in 
Definition El Second contribution, the characterization still holds for two-player games with 
strict weak order preferences, but no longer for three-player games. (Strict weak orders are 
important since they are an abstraction of the usual preference order over the real-valued payoff 
functions.) 

Section El consists of definitions; Section E] proves the characterization for many players and 
linear preferences; Section S] proves the characterization for two players and strict weak order 
preferences. 

Related works Characterizing the preferences that guarantee existence of NE in interesting 
classes of games is not a new idea: earlier than the two examples above f|13]. M), Gimbert and 
Zielonka |10] ’’characterise the family of payoff mappings for which there always exist optimal 
positional strategies for both players” in some win-lose games played on finite graphs. Also, |15] 
characterizes the preferences that guarantee existence of NE in determined, countable two-player 
game forms. 

The notion of SPE has also been studied in connection with system verihcation and synthesis, 
at low levels of the Borel hierarchy: in [26] with qualitative objectives, in [2] with quantitative 
objective for reachability, and in [3] with quantitative objectives and a weak variant of SPE. 

Finally, some specific inhnite games in extensive form (such as the dollar auction) and espe¬ 
cially their SPE have been studied using co-algebraic methods in [18] and [T]. 

2 Technical background 

The games in this article are built on infinite trees, which may be defined as prefix-closed sets 
of finite sequences. The elements of a tree are called nodes. Intuitively, a node represents both 
a position in the tree and the only path from the root to this position. 

Definition 1 (Tree) Let Ti be a set. 

• S* is the set of finite (infinite) sequences over S, and a tree over T, is a subset T of 

S* such that 7 C <5 (i.e. 'y is a prefix of 5) and 6 & T implies 7 € T. 

• For a node 7 in a tree T, let succ(T, 7 ) := {(5 € T | 7 E A |(I| = I 7 I -|- 1}, where I 7 I is 
the length of'j. 

• A tree T is pruned i/succ(T, 7 ) 7 ^ 0 for all 7 G T. 

• Let T be a tree over S. The set [T] is made of the infinite paths ofT, namely the elements 
of whose every finite prefix is in T. 

• Let T be a tree over S. For 7 € T fet Ty := {J G S* | 7(5 G T}. 

In this article the outcomes of a game correspond to some partition of the infinite paths of the 
game tree, and the subsets of the partition are restricted to the Hausdorff difference hierarchy 
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of the open sets. This hierarchy is defined in, e.g., [TTl 22 .E], but a probably-folklore result [T71 
Section 2.4] gives an equivalent presentation, which is in turn rephrased in Definition [4] below. 
These new definitions facilitate the proofs by induction in this article. Then, the Hausdorff- 
Kuratowski theorem (see, e.g., [m Theorem 22.27]) implies that, in the Baire space (i.e. N^), 
the difference hierarchy is equal to A 2 , the sets that are both countable unions of closed sets 
and countable intersections of open sets. This equality tells how low the difference hierarchy lies 
in the Borel hierarchy. 

For every pruned tree T, let { 7 [Ty] ] 7 G T} be a basis for the open subsets of [T]. Def¬ 
inition [ 2 ] below is a special case of a more general definition that can be found, e.g., in m 

22 .E]. 

Definition 2 (Difference hierarchy) Let T be a pruned tree, 6 > he a countable ordinal, 
and {Ari)rj<ce be an increasing sequence of open subsets of[T]. D 0 {{Arf)n<e) is defined as below. 

X G D 0 {{Ari)rj<e) G DrjceArj and the least t] < 6 with x G Arj has parity opposite to that of 6 . 

And ^^([r]) := {Dg{{Aj^)rjC 0 ) \ V?? < 9,Arj is an open subset of [T]}. 

Observation 3 D 0 +i((A^)^< 0 +i) = AoX D 0 ((A^)^<e) 

Definition m Lemma [U and Proposition [7] relate to [171 Section 2.4]. 

Definition 4 (Quasi-difference sets) Let T be a pruned tree. The set D([r]) is defined by 
transfinite induction below. 

• Every open set of [T] is in P([r]). 

• Let be pairwise non-comparable nodes in T, and for all i G I let Di G V{\T\) be 

such that Di C •^i\T-^f\. Then Ujg/Dj G 'D{\T]). 

• The complement in [T] of a set in V([T]) is also in T>([T]). 

One can prove Observation [5] below by induction along Definition 01 

Observation 5 Given a node 7 0 / a pruned tree T, and A G D([r]), 'y[T.y] n ^ G D([r]). 

Lemma 6 D 0 C I)([T]) for all non-zero countable ordinal 6 and all pruned tree T. 

Proof By induction on 9, which holds for 9 = 1 since Di{[T]) is made of the open subsets of 
[T]. Let 0 > 1 be an ordinal and let A G D 0 , so ^ = D 0 {{Arf)n<e) for some family {Ari)n<e of 
open subsets of [T] that is increasing for the inclusion. Every is open so it can be written 
Uie/ 7 r;,i [Tly,, J where and 7 ^^- are not proper prefixes of one another (but are possibly equal) 
for all r] < 9 and i,j G I. We can also require some minimality for all more specifically 
7 C 7 r,,i “'(7[71y] C Ar^). Let F consists of the minimal prefixes among {jn,i \ i G I A g < 9}, 
and for all 7 G F let 7 ( 7 ) be the least 7 such that 7 = 7 ^^* for some i G I. So f{'y) < 9 
for all 7 G F, and A C so A = fl 7 [F 7 ]. Let 7 G F and let us 

make a case disjunction to show that A n 7 [F 7 ] G V{\T]). First case, 7 ( 7 ) and 9 have the same 
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parity, so Af^-i[T^] = n 7 [T^])^</(^)) G Dj(^)([T]), so Ar\-i[T-^] G V{[T]) by induction 

hypothesis. Second case, /(y) and 9 have opposite parity, so 


An7[T.y] 


= L>/(^)+i((^r, n 7[r7])^</(^)+i) by Definition [21 
= n 7 [r.y]) n7[r.y])^</(^))) by ObservationH 

= \ Df{^){{Ar, n by definition of F 9 7 and /{j), 

G F([T]) by induction hypothesis and Observation [5l 


Therefore A G P([T]). 


□ 


Proposition [7] below shows that the quasi-difference sets coincide with the sets in the difference 
hierarchy for countable trees, just like quasi-Borel sets [20] and Borel sets coincide on Polish 
spaces. 

Proposition 7 P([T]) = Ug<:i^-^Dg{[T]) for all countable pruned tree T. 

Proof Ae<^u)iDQ C 'D{\T]) was already proved in Lemma[6l so let A G 'D{\T]). Let us prove 
that A G Dg{[T]) for some 9, by induction on the definition of P([T]). Base case, if A is open, 
AgDi([T]). 

Second case, let be pairwise non-comparable nodes in T, and let Ai G VdT]) 

for all i & I, such that A = Ujg/jdj. By induction hypothesis Ai G Dg^ for some 9i < oji. 
Let 9 := supjgj-Sj, so 0 < by countability of T, and Ai G Dg for all i & I. For all z G / 
let {Ai^fj)rj<8 be an increasing sequence of open sets such that Ai = Dg{{Ai^ri)r)<e)- So A = 
Ui^iDg({Ai^r,)r)<e) = Dg{{\Ji^iAi^r,)r,<e) , which shows that A G Dg(lT]). 

Third case, A is the complement of B G Dg{[T]) for some 9 < oji. So B = Dg{{Brj)n<g) for 
some increasing sequence of open sets of [T]. Let Bg = [T], so = Dg^i{{Brj)n<g+i) ■ □ 


Informally, a play of a game starts at the root of an infinite game tree and at each stage of the 
game the unique owner of the current node chooses a child of the node. The articles m and 
|16] used game trees of the form C* because it was more convenient and done without much 
loss of generality, but this article works with general pruned trees because they will be cut in a 
non-uniform way. Moreover pruned trees are general enough, since leaves in infinite games can 
be simulated by the pseudo-leaves defined below. 

Definition 8 (Game, snbgame, psendo-leaf) An infinite game g is a tuple {A, T, d, O, v, (-<a 
complying with the following. 

• A is a non-empty set (of players). 

• T is a non-empty pruned tree (of possible finite plays). 

• d : T ^ A (assigns a decision maker to each stage of the game). 

• O is a non-empty set (of possible outcomes of the game). 

• u : [r] —>■ O (uses outcomes to value the infinite plays in the tree). 

• Each -<a is a binary relation over O (modelling the preference of player a). 
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For 7 G T, the subgame g-y is defined by d'y : T.y ^ A such that d^{6) := d{'y6) and by : [T^] —)■ 

O such that v^{p) := v{'yp). A x-pseudo-leaf of g is a shortest node 7 G T such that only the 
outcome x occurs in g^. 

Definition 9 (strategy profile, induced play, global-Pareto equilibrium) Let g = {A,T,d,0,v,{-<a 
)a&A) be a game. 

• A strategy profile is a function s : T ^ T such that 5 ( 7 ) G succ(T, 7 ) for all 7 G T. Let Sg 

be the set of the strategy profiles for g. For 7 G T and s £ Sg the subprofile s-y : —>• Ty 

is defined by the equality 'ysy(d) = Sly'S). 

• 7 G T and s G Sg, the play p = p^ls) induced by s at 'j is defined inductively by 
Po . ..p\y\-i := 7 and pn := s{pq . ..pn-i) for all n > | 7 |. 

• A Nash equilibrium is a profile s £ Sg such that 

NEg{s) ;= Vs' G Sg,\/a £ A, -^{vop^ls) ~<a v opals') A (V7 G T, 5(7) / ^ ^(7) = a)) 

A subgame perfect equilibrium is a profile s £ Sg such that NEg^lsy) for all 7 G T. 

• Let O' C O. One says that x £ O' is Pareto-optimal in O' if for all y £ O' and a £ A 

such that x <a y there exists b £ B such that y < 1 , x. A global-Pareto Nash equilibrium 

(GP-NE) is an NE whose induced outcome is Pareto-optimal in the outcomes occurring in 
the underlying game. A GP-SPE is a profile that induces a GP-NE in every subgame. 

The proofs in this article do not build SPE by mere backward induction, but more generally by 
recursively refining rational behavioral promises. At each stage the refinement is optimal given 
the existing promises and regardless of the future ones. Since a promise not to choose a specific 
successor of a given node cannot be represent by a strategy profile, the more general notion of 
quasi-profile is defined below. 

Definition 10 (quasi profile) Let g = {A, T, d, O, v, lAa)a£A) be a game. 

• A quasi profile is a multivalued function q : T —o T such that 0 5 ( 7 ) C succ( 7 ) for 

all 7 G T. Let Qg be the set of the quasi profiles for g. For 7 G T and q £ Qg the 
sub-quasi-profile q^ : Ty —o Ty is defined by the equality ^qy{d) = q{'y6). 

• Tor 7 G T and q £ Qg, the tree induced by q starting at 7 is defined inductively by e £ Ty(q), 
where e is the empty sequence, and 6 £ Ty{q) ^ q-yid) E Ty{q). 

• Let q £ Qg. Let {'yi)i£i be the nodes of T such that 7* ^ 9(7) for all 7 G T, and let 
G{g,q) := {gyi \T.y^{q)}iei■ 

Making a promise in a game g by defining a quasi-profile q splits the game into ’’smaller” 
games, formally via G{g,q). If the promise is rational, these ’’smaller” games can be processed 
independently since gluing any of their respective SPE will yield an SPE for g. Towards this. 

Observation IIII below suggests that the recursive refinement will lead to a fully defined strategy 
profile of g, if performed a sufficiently great (ordinal) number of times. 

Observation 11 Let g be a game on a tree T, let q be a quasi profile for g, and let G{g,q) = 

{d'n \T.y^{q)}iei- Then {'yiTyfiq)}i^i is a partition of T. 
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3 Many players with linearly ordered preferences 


This section characterizes the linear preferences that always yield SPE in games with 
measurable outcome functions: the families of preferences without infinite ascending chains and 
without the SPE killer, i.e. the pattern z <a y <a x A x <b z <b y ior some players a and 
b and outcomes x,y,z. The main difficulty is tackled by Lemma [12] and corollary [13] below. 
It consists in slightly generalizing an existing result [16] stating that two-player Borel games 
with antagonist preferences have SPE by considering preferences that are almost antagonist, 
but in addition there is an outcome y that is the worst one for both players, and the set of 
plays with outcome y is a closed set (union an open set). This is then generalized for a set 
in by induction, and eventually to multi-player games without the SPE killer thanks to a 
combinatorial result. 

Lemma 12 Let a game involve two players a and b, preferences y <a Xn <a ■ ■ ■ <a xi and 
y <b xi <b ■ ■ ■ <b Xn for some n, such that all plays without pseudo-leaves have outcome y. The 
game has a global-Pareto subgame perfect equilibrium. 

Proof Let us consider only infinite games involving two players a and 6 , preferences y <a 
Xn <a ■ ■ ■ <a xi and y <b xi <b ■ ■ ■ <b Xn for some n. Let us call a game weak-stop if every 
play without pseudo-leaves has outcome y, and strong-stop if in addition every node that does 
not lie on a play with outcome y has a prehx that is a pseudo-leaf. Note the following: in 
every weak-stop game the plays with outcome y form a closed set; for every quasi profile q for a 
weak-stop game y, the set G{g, q) contains only weak-stop games; and modifying the outcome 
function of a weak-stop game such that it is constant on given subgames yields a weak-stop 
game. (But the same does not hold for strong-stop games.) Let us call a node of a strong-stop 
game an Ok {bk) node if it is owned by player a ( 6 ), and if it is the parent of a x^-pseudo-leaf. 
Let us call every {bk) node a a-stop ( 6 -stop) node, and furthermore let us call every a-stop 
or 6 -stop node a stop node. 

Let us prove the claim by induction on n, which holds for n = 0 and n = 1, so let us assume 
that 1 < n. Five transformations on games are defined below, and they are meant to be applied 
recursively to a weak-stop game. 

1. ’’Weak-stop towards strong-stop”: Let y be a weak-stop game on tree T. Let 7 be a 
node such that g-f involves more than one outcome but not y. By construction g-^ is an 
antagonist game, and it amounts, when seeing a pseudo-leaf as a leaf, to a game without 
infinite plays, but possibly without uniform bound on the length of the plays. By [S] it 
has a GP-SPE s-^ nonetheless, which induces some Xk- Let us derive a weak-stop game g' 
from y by modihcation of the outcome function: for all p G [T] let v'{p) := if 7 T y and 
v'{p) := v{p) otherwise. Pasting s-^ at node 7 on a GP-SPE s' for g' yields a GP-SPE s for 
y. Formally 5 ( 76 ) := s.y( 6 ) for all 6 & and s((5) := s'( 6 ) for all 6 € T such that 7 ^ 6. 

2. ’’Emptying the interior of y”: Let y be a strong-stop game on tree T and let 7 be a 
y-pseudo-leaf. If 7 = e all prohles for y are GP-SPE. If 7 is not the root of y let us 
dehne a quasi profile q for y by letting the owner of the parent of 7 ignore 7 . Formally, 
q{5) := succ(T, ( 5 )\{ 7 } for all 5 &T. Since y is the worst outcome for both players, none 
will have an incentive to deviate from this promise, regardless of the future choices at the 
other nodes. G{g,q) contains g-/ and a weak-stop game g'. Gombining any prohle s.y for 
y-y and a GP-SPE for g' yields a GP-SPE for y. 
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3. ”5 chooses x„”: Let 5 be a strong-stop game on tree T, let 7 be a 6 ^ node and let 
6 G succ(T, 7 ) be an x^-pseudo-leaf. Let us define a quasi profile q for g by letting b choose 
6 at 7 . Formally, ^( 7 ) := {<5} and q{a) := succ(r, a) for all a G T\{ 7 }. Since Xn is 6 ’s 
preferred outcome, she will have no incentive to deviate from this choice, regardless of the 
choices at the other nodes. So, finding a GP-SPE for every weak-stop game in q) will 
complete the definition of a GP-SPE for g. 

4. ”a ignores Let <7 be a strong-stop game. Let 7 be a node in g such that g-^ involves 
outcome y but no 6 -stop nodes, and such that every subgame of g.y involving outcome y 
has an node for some k < n. Let us define a quasi profile q for g by letting a ignore all 
Xn-pseudo-leaves at all an nodes below 7 . The set G{g, q) is made of games involving only 
outcome Xn and of one g' such that g'^ does not involve x„. By induction hypothesis g'^ has 
an GP-SPE s'^, which induces some x^. Let us define g" by modification of the outcome 
function of g: for all p G jlT-y] let v"{p) := Xk and for all p G [T]\ 7 [r.y] let v"{p) := v{p). 
Pasting sly on a GP-SPE s" for g" yields a GP-SPE for g. 

5. ”a chooses x^”: Let g he a strong-stop game. Let 7 be such that g^ involves outcome y 
and every subgame of g^ involving y has some nodes but no node for all k < n. To 
build for g^ a GP-SPE s-y inducing Xn on all of its subprofiles, it suffices, first, to choose 
arbitrary profiles for the subgames rooted at the x^-pseudo-leaves of g^, and second, to fix 
consistently paths from each node to an Xn-pseudo-leaf. This second step can be done by 
letting player a choose an x^-pseudo-leaf at some node, which defines a quasi profile q, and 
by repeating it recursively for the games in G{g^,q). This s-y is a GP-SPE because every 
subprofile induces outcome x^, which is 6 ’s preferred outcome, and the only alternative 
for a in every subprofile is outcome y since all a-stop nodes are On nodes. Let us define g' 
by modification of the outcome function of g: for all p G ^\T-y\ let v'{p) := Xn and for all 
p G [T]\ 7 [T 7 ] let v'{p) := v{p). Pasting s-y on a GP-SPE s' for g' yields a GP-SPE for g. 

Given a weak-stop game g, let us apply to it the five transformations above, sequentially, 
non-deterministically whenever they are applicable, and until none of them is applicable, i.e. 
possibly an ordinal number of times. This yields a set G of strong-stop games (otherwise 
Transformation [T] could be applied) whose subgames that involve outcome y all have stop nodes 
(otherwise Transformation [2] could be applied), without bn nodes (otherwise Transformation [3] 
could be applied), such that every subgame that involves y but no 6 -stop nodes has a subgame 
without ak nodes for all k < n (otherwise Transformation H] could be applied), and such that 
every subgame h' of every game in G has the following property (otherwise Transformation [5] 
could be applied): if every subgame of h' has a a-stop node, h' has an ak node for some k < n. 

Let h' be a subgame of 6 , G G, and that involves y. If h' has no 6 -stop nodes, combining the 
properties above shows that all of its subgames have a-stop nodes, so one of them has only a„ 
nodes, contradiction, so every subgame of h that involves y has a 6 -stop node. 

For every h G G let us define the quasi profile q by letting a ignore all the x^-pseudo-leaves. 
G{h,q) is made of games involving the outcome x„ only and of one h' void of Xn- Since every 
subgame of h that involves y has a 6 -stop node, it also holds for h'. By induction hypothesis, h' 
has a GP-SPE, which is easily extended to a GP-SPE for h, thus completing the definition of a 
GP-SPE for the original g. □ 

Corollary 13 Given a game g with two players a and b, a quasi-Borel measurable outcome 
function, and preferences y <a Xn <a ■ ■ ■ <a xi and y <b xi <b ■ ■ ■ <b Xn for some n. If the 
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plays with outcome y form the union of an open set and a closed set, the game has a global-Pareto 
subgame perfect equilibrium. 

Proof Let the plays with outcome y be the union Y = U of an open set and a closed 
set. Wlog Yq and Yc are disjoint. Let us derive g' from g by removing the plays in Yj,. So the 
plays of g' that do not yield outcome y form an open set, i.e. a disjoint union of clopen balls 
with defined by the prefixes (yOigr- Every game g.y^ is antagonist and quasi-Borel, so it has 
an SPE Si by [TB]. Let us define g” by modification of the outcome function of g'-. every play 
going through 7 * yields the outcome induced by Sj. This g" has a GP-SPE ,s" by Lemma HU 
and together with the st it can be used to build a GP-SPE for g. □ 

Let us extend Gorollary [13] from open union closed to the difference hierarchy. 

Lemma 14 Let he a game on a tree T, with two players a and b and preferences y <a Xn <a 
■ ■ ■ <a xi and y <b xi <b ■ ■ ■ <h Xn, and let us assume that each set of plays with outcome Xi 
is quasi-Borel and that Y the set of plays with outcome y is in T>t^^([T]). Then the game has a 
global-Pareto subgame perfect equilibrium. 

Proof By transhnite induction on the level of Y in the difference hierarchy. The base case 
where Y is open or closed is solved by Gorollary [T3l 

Eor the inductive case, let us make a case disjunction depending on the last step of the 
construction of Y. Eor the union case, Y = for some Yj that have lower levels than 

Y in the difference hierarchy, and where the 7 , are not prefixes of one another. By induction 
hypothesis each g-^^ has a GP-SPE Si inducing either y or an outcome 0 :^ 7 ). Let us start the 
construction of a profile s for g by fixing the Si as the respective subprofiles for the g ■ Let 
us define g' by modification of the outcome function of g: let each play going through 7 j yield 
the outcome induced by s*. This is a quasi-Borel game and the plays with outcome y form an 
open set, so it has a GP-SPE s' by Gorollary 1131 which we use to complete the definition of s. 
It is easy to check that s is a GP-SPE for g. 

Eor the complementation case, Y = [T]\([T]\y), where [T']\E is equal to UjgpjyjXi for some 
Xi that have lower levels than [r]\E (and E) in the difference hierarchy, and where the 7 ^ are 
not prefixes of one another. Since all Y n [yiT-ff\ = [^iT-ff\\"fiXi have lower levels than Y in the 
difference hierarchy, by induction hypothesis each has a GP-SPE Si inducing either y or an 
outcome Xfc(j). Let us start the construction of a profile s for g by fixing the Si as the respective 
subprofiles for the g \-hTj. ■ Let us define g' by modification of the outcome function of g: let 
each play going through 7 j yield the outcome induced by Sj. This is a quasi-Borel game and the 
plays with outcome y form the union of an open set and the closed set [T]\Ui G/ [7iLlyJ, so it has 
a GP-SPE s' by Gorollary 1131 which we use to complete the definition of s. It is easy to check 
that s is a GP-SPE for g. □ 

The combinatorial Lemma M below shows that the ’’local” absence of the SPE-killer amounts 
to a very simple ’’global” structure. 

Lemma 15 Let A he a non-empty set and for all a a A let <„ be a strict linear order over 
some non-empty set O. The following assertions are equivalent. 

1. Va, 6 € A,\/x,y,z G O, -.(z <a y <a x A x <b z <b y). 

2. There exists a partition of O and a linear order < over L such that: 

(a) i < j implies x <ay for all a ^ A and x € Oi and y ^ Oj. 
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(^) <6|Oi=<a|oi or <^,\o^=<a\o] for all a,b e A. 

If 1. and 2 . hold, we may also assume that <b\oi=<a\ol witnessed for all i ^ I. Also, Oi is 
always a <a-interval for all {i,a) G I x A, as implied hy\^ 

Proof [ 2 ]^[T] is straightforward, so let us assume [T] Let x ~ y stand for 3a, b G A, x <a 
y X, which defines a reflexive and symmetric relation, and note that due to the SPE killer 
z <a y <a X A X <b z <b y the following holds: if x <„ y and y <b x, then x <a z <a y iS 
y <b z <b X. To show that ~ is transitive too, let us assume that x ^ y ^ z. If x,y,z are not 
pairwise distinct, x ~ z follows directly, so let us assume that they are pairwise distinct, so by 
assumption there exist a,b,c,d G A such that y <a x <b y <c z <d y. To show that x ~ z 
there are three cases depending on where z lies with respect to y <a x, all cases invoking the 
(above-mentioned) forbidden-pattern argument: if y <a z <„ x then x <b z <b y, and x ~ z 
follows; if y <a X <a z then z <d x <d y and subsequently y <c x <c z, by invoking twice the 
forbidden-pattern argument, and x ~ z follows; third case, let us assume that z <a y <a x. If 
X <b z then x ~ z follows, and if z <b x then z <b x <b y, so y <c x <c z, and x ~ z follows. 
Therefore ~ is an equivalence relation; let be the corresponding partition of O. 

Now let us show that the ~-classes are <a-intervals for all a, so let x ~ y and x <a z <a y. 
By definition of ~, there exists b such that y <;, x, in which case y< 6 Z<;,xby the forbidden- 
pattern argument, so x ~ z by definition. 

Let X G Oi and y G Oj be such that x <a y. Since Oi and Oj are intervals, x' <a y' for all 
x' G Oi and y' G Oj. Since -■(x' ~ y') by assumption, x' <b y' for all b G A, hy definition of ~. 
In this case dehning i < j meets the requirements. 

Before proving [20 let us prove that if x <« y and y <b x and z ^ y, then z <a y iff y <6 z: 
this is trivial if z equals x or y, so let us assume that x ^ z ^ y, and also that z <a y. If z <b y, 
then y <c z for some c since z ^ y, and wherever x may lie with respect to y <c z, it always 
yields a SPE killer using <„ or <b, so y <b z. The converse is similar, it follows actually from 
the application of this partial result using and instead of <« and <b. 

Now assume that <b\oi¥"<a\oi for some Oi, so x <„ y and y <b x for some x,y G Oi. Let 

z,t G Oi. By the claim just above z <a y y <b z, so by the same claim again z <a t t <b z, 

which shows that <b\oi=<a\ol■ This proves the equivalence. 

Einally, let us assume that the assertions hold. By definition of ~, if O* is not a singleton, 
X <a y and y <b X for some a,b G A and x,y G Oi, so <b\oi=<a\cr witnessed. □ 

Theorem 1161 extends Lemma [TT] to many players and more complex preferences. 

Theorem 16 Let g be a quasi-Borel game with players in A, outeomes in O, and linear pref¬ 
erences <a for all a G A. Let us assume that the inverses of the <a are well-ordered, and that 
there exists a partition of O and a linear order < of I sueh that: 

• i < j implies x <a y for all a G A and x G Oi and y G Oj. 

• <b\0i=<a\0i or <b\oi=<a\o] for all a,b G A and i G I. 

Let us further assume that for all i G I the plays with outeome in Uj^iOj form a set. Then 
g has a global-Pareto subgame perfect equilibrium. 

Proof By Lemma fTCl let us further assume wlog that <b\oj=<a\o^. is witnessed for all j G I, 
so the Oj are finite by well-ordering. Let us build a GP-SPE for g as the limit of a recursive 
procedure: Let Oi be such that some outcome of Oi occurs in g and such that for all j > z no 
outcome from Oj occurs in g. Let {yk)k&K be the shortest nodes of g such that the outcomes 
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occuring in are in Uj<jOj only. Let us define a quasi profile q for g by having the 7 ^ ignored 
by their parents. G{g, q) consists of the g^^, and of a game g'. By Lemma O there is a GP-SPE 
s' for g'. (To see this, replace with one single fresh outcome y, i.e. y ^ O and set y <a x 

for all o € A and x G Oj.) Combining s' with GP-SPE for the g-^f, (obtained recursively) yields 
a GP-SPE for g, since the choices made in g' hold regardless of the choices made in the g^^_. □ 

Corollary 17 Let A and O he non-empty finite sets (of players and of outcomes) and for all 
a ^ A let <a he a linear preference. The following are equivalent. 

1. ya,b G A,yx,y,z G O, ^{z <a y <a x A x <b z <b y). 

2. Every T>^^.^-Gale-Stewart game using A, O and the <a has a GP-SPE. 

Proof For 1. => 2. invoke Lemma M and Theorem m and prove 2 . => 1 
with the following folklore example which is detailed, e.g., in |16] . 
start-> a —> b —> a —> b-x 

1111 

y z y z 

Corollary [T7] and the results that lead to it considers linear preference only. Proposition [18] 
below show that this restriction incurs a loss of generality, which is partly solved in Section H| 

Proposition 18 Let us define two binary relations by z, t <a x,y and y ^b z Pb x ^b t- 

1. infinite games with players a and b and preferences -<a and -<b have SPE. 

2. The SPE killer occurs in any strict linear extensions of -<a and -<b. 

Proof 1. follows Theorem [22] For 2. let -<'^ be a linear extension of -<a. If x y then 
z ~<'a X ^'g^y and y <b z ~<b x. If y -<'a x then t <'^y -<'^ x and y ^b x ^b t. □ 

4 Two players with strict weak order preferences 

The preferences considered in Proposition [18] are strict weak orders. Informally, strict weak 
orders are strict partial orders that can be seen as strict linear orders from afar, i.e. up to an 
equivalence relation. Traditionally in game theory the outcomes are real-valued payoff functions 
f,g : A ^ R. and the preferences are defined by / 5 iff /(o) < g{o). These preferences are 

not strict linear orders but they are strict weak orders, so the results from Section [3] are worth 
generalizing. Strict weak orders are defined below. 

Definition 19 (Strict weak order) A strict weak order is a strict partial order whose com¬ 
plement is transitive, i.e. is satisfies -^{x -< x) and x y Ay R z ^ x -< z and -■(x ^ y) A- 1 ( 7 / ^ 
z) -'(x ^ z). 

Lemma fTCl above describes the structure of strict linear orders void of the SPE killer. A similar 
result for strict weak orders will be useful. Lemma [ 20 ] below is part to it, and the other part 
appears directly in the proof of Lemma fTH 

Lemma 20 Let -<a and -<b be two strict weak orders over some finite O. 


. by contraposition 


□ 
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1. If -<a and -<i) are void of the SPE killer, if there exists a ^a-aon-extremal element and a 
-<b-non-extremal element, and if there is no partition {Ou,Oi} of O sueh that -■(x -<a v) 
and -<{x -<b y) for all {x,y) € Ou x Oi, then -<a fl -<i,= 0 . 

2. If <a n -<b= 0? there exists a linear extension < of -<a such that 

Proof 

1. Let x be among the ^Q-maximal elements, and let y be ^a-minimal among 

the ^fe-maximal elements, so x 7 ^ y by the partition assumption. Towards a contradiction 
let us assume that, e.g., x is not ^b-minimal, and let z be -<;,-minimal. For all t -<b x, 
it follows that t is not -<a-maximal by definition of x, and -■(?/ ~<a t) by absence of the 
SPE killer. So y is not -^Q-minimal, otherwise z is also ^a-minimal, thus contradicting the 
partition assumption. So likewise, for all t -<a y, it follows that t is not ^ft-maximal by 
dehnition of y, and -■(x -<b t) by absence of the SPE killer. So the two-element partition 
induced by {t G O | t y 'I t Pb x} contradicts the partition assumption. This shows 
that X is ^ft-minimal and y is ^a-minimal. Towards a contradiction let us assume that 
t{^a n -<b)z for some t,z € O. So {x, y} n {z, t} = 0. By the partition assumption z is 
not both -<a and ^b-maximal, so, e.g., z -<a x, and t is not both -<a and ^b-™iiiimal. By 
absence of the SPE killer t is ^b-minimal, so y <a t by the partition assumption., and 
subsequently 2 ; is ^fe-maximal. By assumption there exists 7 that is neither ^ft-maximal 
nor ^f,-minimal. Wherever 7 lies wrt -<a, the SPE killer occurs. 

2. By induction on the cardinality of O, which holds for |0| = 0. Let x be ^fc-minimal 
among the ^a-maximal elements, so x is also ^;,-minimal since -<a Ll -<b= 0 - By induction 
hypothesis let <x witness the claim for ^a|o\{a:} and ^ 6 |o\{x}- The linear order < := <x 
U{(?/, x) I y € 0\{x}} witnesses the claim. 

□ 


Lemma [21] below is a generalization of Corollary [T3| from an order-theoretic point of view and a 
special case thereof from a topological point of view. Due lack of space and strong similarities 
with the proof of Lemma fT^ the proof of Lemma [21] is in appendix. 

Lemma 21 Let g be a game with two players a and b, finitely many outcomes O, and strict 
weak order preferences void of the SPE killer. If each outcome corresponds to the union of an 
open set and a closed set, the game has an SPE. 

Furthermore, for every node ^ of g let {Oj,..., On.y} be a partition of the outcomes of g^ 
such that -'(x -<a y) and -■(x -<b y) for alll <k <n^ and (x,y) € x O^. There exists an 

SPE for g such that the outcome induced at every node 7 belongs to OZ.y • 

Proof By induction on the number of outcomes, which holds up to two outcomes. Let us 
make a case disjunction for the inductive case. Eirst main case, there is no partition {0^,0/} 
of O such that V(x, y) G OuX Oi, -■(x -<a y) A -■(x -<b y). Let us make a nested case distinction. 
Eirst nested case, there exists a ^a-non-extremal element and a ^^-non-extremal element, so by 
Lemma [20] let < be a linear extension of -Ka such that By |16j the antagonist game 

with preference < has an SPE, which is also an SPE for -<a and -<b. 

Second nested case, one preference, e.g., -<a has only extremal elements. By the partition 
assumption let y be ^fe-maximal and ^a-minimal. Let Y be the set of plays with outcome y, and 
let us define a quasi-profile q as follows. Let 7 be the parent of a y-pseudo-leaf. If 7 is owned by 
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a, let a ignore the y-pseudo-leaves at 7 ; otherwise let b choose a y-pseudo-leaf at 7 . Let us apply 
this construction recursively (an ordinal number of times) to the games in G{g, q) that do not 
involve y, until the Y' of each remaining game has empty interior. It is easy to check that Y' is 
also closed since Y is the union of an open set and a closed set, by assumption. So let {'yi)i£i 
be the shortest nodes that are not on any play with outcome y. The do not involve y, so by 
induction hypothesis they have suitable SPE s* inducing some Xi € O, which allow us to start 
the definition of a suitable SPE for g. Let us define g' by modification of the outcome function 
of g: let v'{'yip) := Xi for all i € I and let v'{p) := v{p) when ^i%p for all z € I. Let Ma be the 
^a-maximal outcomes, and let us define a quasi-profile q' for g' as follows. Let 7 be the parent 
of a Ma-pseudo-leaf, i.e. a shortest node involving outcome in Ma only. If 7 is owned by a, let 
a choose a Ma-pseudo-leaf at 7 ; otherwise let b ignore the Ma-pseudo-leave at 7 . Let us apply 
this recursively to the games in G{g',q) that involve y. In the remaining games a can deviate 
from a play with outcome y only to reach a (0\)Ma-pseudo-leaf, so every profile that follows 
plays with outcome y whenever possible is a suitable SPE. 

Second main case, there exist partitions {Ou,Oi} of O such that V(x,y) £ Ou x Oi,^{x -<a 
y) A -'(x y). Among these partitions let us consider the one with the smallest possible 

Ou- Let us make a further case disjunction. First case, \Oi\ > 1. As is now customary, let us 
start defining a suitable SPE for g by using the induction hypothesis on the maximal subgames 
involving only outcomes in Oi, and on the game derived from g by replacing outcomes in Oi 
with a fresh outcome y that is the new -<a and ^f,-minimum. 

Second case, \Oi\ = {y}. By minimality of \Ou\-, there is no partition {Ouu,Oui} of Ou such 
that V(x,y) € Ouu x Oui,^{x -<a y) A -<{x -<b y). Therefore the situation is reminiscent of the 
first main case above, but for -<a|o„ and ^b\Ou instead of -<a and -<b- In both nested cases 
from the first main case, there exists some Xn that is, e.y., ^a|o„-niinimal and ^b|o„-maximal. 
Applying the proof of Lemma [12] almost verbatim yields a suitable SPE for g 

□ 


Theorem 22 Let g be a game with two players a and b, finitely many outcomes, a 
measurable outcome function, strict weak order preferences such that -<{z -<a V <a x L x <b 
z -<b y) for all outcomes x, y and z. Then the game has an SPE. 

Furthermore, for euery node 7 0 / y let {Oj ,..., OZ.,} he a partition of the outcomes of g^ 
such that -i(x -<a y) and ->(x -<b y) for alll <k <n^ and (x,y) G x There exists an 
SPE for g such that the outcome induced at every node 7 belongs to OZ~, ■ 

Proof By induction on the levels in the difference hierarchy of the sets of plays corresponding 
to the outcomes. The base case holds by Lemma (211 

For the inductive case, let y be an outcome whose corresponding set Y has level more than 
one in the difference hierarchy, and let us make a case disjunction depending on the last step of 
the construction of Y. The remainder of the proof can be taken almost verbatim from the proof 
of Lemma [m but by replacing ’’GP-SPE” with ’’suitable SPE”, and by invoking Lemma [211 or 
the induction hypothesis instead of Corollary 1131 □ 

Theorem [22] considers two-player games only. Observation [23] shows that absence of the SPE 
killer is no longer a sufficient condition for a three-player game with strict weak order preferences 
to have an SPE. 

Observation 23 Let three players a,b and c have preferences z <a V x and t ^b z <b V 
and x ~<ct <c y- (and, e.g., y ^at, z x, and y z or x z) 
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1. The SPE killer does not occur in the strict weak orders -<a and -<b and -<c- 

2. The following game with -<a and -<b and -<c has no SPE. 

start -> a —> 5 —> c —> a —> 5 —> c- x 

1 1 1 1 1 1 

y z t y z t 

Proof For [2j Towards a contradiction let us assume that there exists an SPE for the game. 
Let us consider a node where player a chooses y. Then at the node right above it c chooses 
to continue to benefit from y, and at the node above b chooses to continue, too. The induced 
outcome at the node further above is y regardless of the choice of a, and so on up to the root. 

Let us make a case disjunction: first case, there exists infinitely many nodes where a chooses 
y, so b and c always continue by the remark above, so a has an incentive to continue too, 
to induce outcome x, contradiction. Second case, there exists a node below which a always 
continues. From then on, one player must stop at some point, otherwise the outcome is x and 
c has an incentive to stop. The first player to stop cannot be 6 , otherwise a would stop before 
b, and it cannot be c, otherwise b would stop before c, contradiction. □ 

Proposition [23] below shows that considering only strict weak orders incurs a loss of generality. 

Proposition 24 Let us define two binary relations by <a y ~<a x and z <a fi ~<a ot and 
X z < y and a <bl fi- 

1. The SPE killer occurs in every strict weak order extensions of -<a and -<b. 

2. Vi^j^-games with players a and b and preferences -<a and -<b have SPE. 

Proof 

1. Let be a strict weak order extension of -<a. If .z ~<a y, the SPE killer occurs, with x. If 
->(z -<a y), then <'a fi and the SPE killer occurs, with a. 

2. It suffices to prove the claim for games where each outcome set is the union of an open 

set and a closed set. (Then using a transfinite induction as in the proof of Lemma [TT] will 
do.) The techniques from Lemmas [T 2 ] and [2X1 are suitable here, and used without details. 
If the outcome x does not occur in the game, note that -<a|o\{i} and -< 6 |o\{a:} can be 
extended into the strict weak orders z 7 /3 y a and z a 7 y /?, 

respectively, and that the SPE killer is absent from these. So by Theorem 1221 the game has 
an SPE wrt and and therefore also wrt -<a and -<b- (And likewise if the outcome a 
does not occur in the game.) 

Now one can reduce the set for x to a closed set by letting a choose the clopen balls with 
constant outcome x and by letting b ignore them. The plays with outcomes different from 
X can be seen as belonging to a union of subgames without x, so by the remark above they 
have SPE. It allows us to replace these subgames with (pseudo)-leaves with outcomes the 
ones induced by the SPE. Now one can let a choose the pseudo-leaves with outcome a and 
b ignore them, which yields a game without outcome a. So by the remark above there is 
an SPE for the game. 

□ 
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